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Abstract 


The  task  of  planning  tr^ect<Hies  fcv  a  mobile  robot  has  received  considerable  attention  in  the  research  literature. 
Alguithms  exist  fw  handling  a  variety  of  robot  shapes,  configurations,  motion  constraints,  and  environments.  Most 
of  the  wmic  assumes  the  robot  has  a  complete  and  accurate  model  of  its  environmmt  before  it  begins  to  move;  less 
attention  has  been  paid  to  the  problem  of  unknown  or  partially-known  environments.  This  situation  occurs  for  an 
e}q)loratory  robot  w  one  that  must  move  to  a  goal  location  without  the  benefit  of  a  floorplan  (indoor)  or  terrain  m^ 
(outdoor).  Existing  ^)proaches  plan  an  initial  global  path  or  route  based  on  known  information  and  then  modify  the 
plan  locally  as  the  rotot  discovers  obstacles  with  its  sensors. While  this  strategy  works  well  in  environments  with 
small,  sparse  obstacles,  it  can  lead  to  grossly  suboptimal  and  incomplete  results  in  cluttered  spaces.  An  alternative 
ai^roach  is  to  replan  the  global  path  from  scratch  each  time  a  new  obstacle  is  discovered.  While  this  approach  is 
optimal,  it  is  grossly  inefficient  and  can  require  a  high-performance  computer  fOT  real-time  operation.  This  prq>er 
introduces  a  new  algorithm.  O'",  crqrable  of  planning  paths  in  unknown,  partially  known,  and  changing  environments 
in  an  efficient,  optimal,  and  complete  marmer.  D*  models  the  environment  as  a  graph,  where  each  node  represents  a 
robot  state  (e.g.,  a  location  in  a  room),  and  each  arc  represents  the  cost  (e.g.,  distance  to  travel)  of  moving  between 
two  states.  Initially,  a  path  is  planned  from  the  goal  to  the  robot’s  location  using  known  information.  As  the  robot 
moves,  its  sensors  discover  obstacles  in  its  path.  These  discoveries  are  handled  by  modifying  the  arc  costs.  D* 
propagates  uiformation  minimally  about  these  arc  changes  in  the  graph  to  compute  a  new  optimal  path.  The  process 
repeats  until  the  robot  reaches  the  goal  or  determines  that  it  cannot.  After  a  discussion  of  prior  work,  the  paper 
introduces  the  algorithm,  proves  its  soundness,  optimality,  and  completeness,  illustrates  some  path  planning 
applications,  compares  it  to  an  alternative  algorithm,  and  sununarizes  the  results. 
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1.0  Introduction 

The  research  literature  has  adchcssed  extraisiveiy  the  motion  planning  problem  for  one  or  more  robots  moving 
tlrougb  a  field  of  obstacles  to  a  goal.  Most  of  this  work  assumes  that  the  environment  is  completely  known  before  the 
robot  begins  its  traverse  (see  Latombe  [10]  for  a  good  survey).  The  optimal  algorithms  in  this  literature  search  a  state 
space  (e.g..  visibility  graph,  grid  cells)  using  the  distance  transform  [6]  or  heuristics  [14]  to  find  the  lowest  cost  path 
from  the  robot’s  start  state  fit  the  goal  state.  Cost  can  be  defined  to  be  distance  travelled,  energy  expended,  time 
exposed  to  danger,  etc. 

Unfortunately,  the  robot  may  have  partial  or  no  infonnation  about  the  environment  before  it  begins  its  traverse  but  is 
equqq>ed  with  a  sensm  that  is  capable  of  measuring  the  environment  as  it  moves.  One  approach  to  path  planning  in 
this  scenario  is  to  generate  a  “global”  path  using  the  known  information  and  then  attempt  to  “locally”  circumvent 
obstacles  on  the  main  route  detected  by  the  sensors  [5].  If  the  main  route  is  completely  obstructed,  a  new  global  path 
is  planned.  Lumelsky  [13]  initially  assumes  the  environment  to  be  devoid  of  obstacles  and  moves  the  robot  directly 
toward  the  goal.  If  an  obstacle  obstructs  the  path,  the  robot  moves  around  the  perimeter  until  the  point  on  the  obstacle 
nearest  the  goal  is  found.  The  robot  then  proceeds  to  move  directly  toward  the  goal  again.  Pirzadeh  [16]  adopts  a 
strategy  whereby  the  robot  wanders  about  the  environment  until  it  discovers  the  goal.  The  robot  repeatedly  moves  to 
the  adjacent  location  with  lowest  cost,  and  increments  the  cost  of  a  location  each  time  it  visits  it  to  penalize  later 
traverses  of  the  same  space.  Korf  [9]  uses  initial  map  infonnation  to  estimate  the  cost  to  the  goal  for  each  state  and 
efficiently  updates  it  with  backtracking  costs  as  the  robot  moves  through  the  environment. 

While  these  approaches  are  complete,  they  are  also  suboptimal  in  the  sense  that  they  do  not  generate  the  lowest  cost 
path  given  the  sensor  infonnation  as  it  is  acquired  and  assuming  all  known,  a  priori  information  is  correct.  It  is 
possible  to  generate  optimal  behavior  by  computing  an  optimal  path  from  the  known  map  information,  moving  the 
robot  along  the  path  until  either  it  reaches  the  goal  or  its  sensors  detect  a  discrepancy  between  the  map  and  the 
environment,  updating  the  mtq>,  and  then  replanning  a  new  optimal  path  from  the  robot’s  current  location  to  the  goal. 
Although  this  brute-force,  replanning  approach  is  optimal,  it  can  be  grossly  inefficient,  particularly  in  expansive 
environments  where  the  goal  is  far  away  and  little  map  infonnation  exists.  2^1insky  [22]  increases  efficiency  by  using 
a  quad-tree  [19]  to  represent  free  and  obstacle  space,  thus  reducing  the  number  of  states  to  search  in  the  planning 
space.  For  natural  terrain,  however,  the  map  can  encode  robot  traversability  at  each  location  ranging  over  a 
continuum,  thus  rendering  quad-trees  inappropriate  ch*  subrptimal. 

This  p^r  presents  a  new  algorithm  for  generating  optimal  paths  for  a  robot  operating  with  a  sensor  and  a  map  of  the 
environment.  The  map  can  be  complete,  empty,  or  contain  partial  information  about  the  environment.  For  regions  of 
the  environment  that  are  unknown,  the  m^  may  contain  proximate  infonnation,  stochastic  models  for  occupancy, 
or  even  a  heuristic  estimates.  The  algorithm  is  functionally  equivalent  to  the  brute-force,  optimal  replanner,  but  it  is 
far  more  efficient. 

The  algorithm  is  formulated  in  terms  of  an  optimal  find-path  problem  within  a  directed  graph,  where  the  arcs  are 
labelled  with  cost  values  that  can  range  over  a  continuum.  The  robot’s  sensor  is  able  to  measure  arc  costs  in  the 
vicinity  of  the  robot,  and  the  known  and  estimated  arc  values  comprise  the  nuq).  Thus,  the  algorithm  can  be  used  for 
any  planning  representation,  including  visibility  gr^hs  [11]  and  grid  cell  structures. 

The  paper  continues  with  a  description  of  the  algorithm,  followed  by  proofs  of  its  soundness,  optimality,  and 
completeness.  A  number  of  path  planning  applications  are  illustrated.  First,  optimal  paths  are  generated  for  a  point¬ 
sized  robot  with  no  map  information.  More  involved  problems  are  then  addressed,  including  planning  with  robot 
shtqte,  dead-reckoning  error,  dynamic  environments,  occupancy  maps,  potential  fields,  natural  terrain  environments, 
multiple  goals,  and  multiple  robots.  The  paper  concludes  with  an  empirical  comparison  of  the  algorithm  to  the 
optimal  replanner,  and  the  results  are  summarized. 
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2.0  The  D*  Algorithm 

The  name  of  the  algtvitfam,  D'*,  was  chosen  because  it  resembles  A*  [14],  except  that  it  is  dynamic  in  the  sense  that 
cost  parameters  can  change  during  the  [m)blem-solving  process.  Provided  that  robot  motion  is  properly  coupled  to  the 
algtmthm,  D*  generates  optimal  trajectories.  This  section  begins  with  the  definitions  and  notation  used  in  the 
algorithm,  then  presents  the  O’*  algorithm,  and  closes  with  an  illustration  of  its  (^ration. 

2.1  O«finitlons 

The  objective  of  a  path  planner  is  to  move  the  robot  from  some  location  in  the  wwld  to  a  goal  location,  such  that  it 
avoids  all  obstacles  and  minimizes  a  positive  cost  metric  (e.g.,  length  of  the  traverse).  The  problem  space  can  be 
formulated  as  a  set  of  states  denoting  robot  locations  connected  by  directional  arcs,  each  of  which  has  an  associated 
cost  The  robot  starts  at  a  particular  state  and  moves  across  arcs  (incurring  the  cost  of  traversal)  to  other  states  until  it 
reaches  the  goal  state,  denoted  by  G.  Every  state  X  except  G  has  a  backpointer  to  a  next  state  K  denoted  by 
b(X)  =  Y.  O’*  uses  backpointers  Co  represent  paths  to  the  goal.  The  cost  of  traversing  an  arc  from  state  Y  to  state  X  is 
a  positive  number  given  by  the  arc  cost  function  c(X,  y) .  If  y  does  not  have  an  arc  to  X,  c(X,  Y)  is  undefiiKd.  The  arc 
cost  function  can  be  either  directional  (i.e.,  c(X,  Y)*c(Y,X))ot  bidirectional  (i.e.,  c(X,  Y)  =  c{Y,X)).  Two  states  X  and 
y  are  neighbors  in  the  space  if  c(X,  Y)  or  c(y.  X)  is  defined. 

Similar  to  A'^,  D'*'  maintains  an  OPEN  list  of  states.  The  OPEN  list  is  used  to  propagate  iuformation  about  changes  to 
the  arc  cost  function  and  to  calculate  path  costs  to  states  in  the  space.  Every  state  X  has  an  associated  tag  t(X) ,  such 
that  t(X)  =  NEW  if  X  has  never  been  on  the  OPEN  list,  /(X)  =  OPEN  if  X  is  currently  on  the  OPEN  list,  and 
t(X)  =  CLOSED  if  X  is  no  longer  on  the  OPEN  list.  For  each  state  X,  D*  maintains  an  estimate  of  the  sum  of  the  arc 
costs  from  X  to  G  given  by  the  path  cost  function  h(G,X).  For  the  goal  state,  h{G,  G)  =  0.  Under  the  proper 
conditions,  this  estimate  is  equivalent  to  the  t^timal  (minimal)  cost  from  state  X  to  G,  given  by  the  function  o(G,  X) . 
For  each  state  X  on  the  OPEN  list  (i.e.,  t(X)  =  OPEN),  the  previous  cost  function,  p(G,  X),  is  defined  to  be  equal  to 
h(jG,  X)  before  insertion  on  the  OPEN  list.  Thus,  the  previous  cost  function  classifies  a  state  X  on  the  OPEN  list  into 
one  of  two  types:  a  RAISE  state  if  p(G,  X)  <  h(G,  X) ,  and  a  LOWER  state  if  p(G,  X)  i.  h(G,  X) .  D*  uses  RAISE  states  on 
the  OPEN  list  to  propagate  infoimatioo  about  path  cost  increases  (e.g!,  due  to  an  increased  arc  cost)  and  LOWER 
states  to  propagate  information  about  path  cost  reductions  (e.g.,  due  to  a  reduced  arc  cost  or  new  path  to  the  goal). 
The  propagation  takes  place  through  the  repeated  removal  of  states  from  the  OPEN  list  Each  time  a  state  is  removed 
from  the  list,  it  is  expcmded  to  pass  cost  changes  to  its  neighbors.  These  neighbors  are  in  turn  placed  on  the  OPEN  list 
to  continue  the  process. 

States  on  the  OPEN  list  are  sorted  by  their  key  function  value,  kfG.X),  defined  to  be  mirt(h(G,  X),  p{G,  X))  if 
t(X)  =  OPEN  and  undefined  if  t(X)  *  OPEN.  The  parameter  is  defined  to  be  min(k(X))  for  all  X  such  that 
r(X)  =  OPEN.  The  parameter  represents  an  important  threshold  in  D*:  path  costs  less  than  or  equal  to  are 
optimal,  and  those  greater  than  may  not  be  optimal.  The  parameter  k^,j  is  defined  to  be  equal  to  k^.^  prior  to 
most  recent  removal  of  a  state  from  the  OPEN  list.  If  no  states  have  been  removed,  k^^  is  undefined. 

An  ordering  of  states  daioted  by  {Xj.X^}  is  defined  to  be  a  sequence  if  b(X-^ ,)  =  X,  for  all  i  such  that  l  s « <  Af  and 
Xj  ^  Xj  for  all  (i,j)  such  that  l^i<jiN.  Thus,  a  sequence  defines  a  path  of  backpointers  fftxn  Xj^to  X, .  A  sequence 
{XjJr^}  is  defined  to  be  monotonic  if  (f(Xj)  =  CLOSED  and  /i(G,X()<A(G,Xj^.i))  or  (r(X,)  =  OPEN  and 
p(G,X()<li(G,Xj^j))  for  all  i  such  that  l  Si</V.  D*  constructs  and  maintains  a  monotonic  sequence  {GX}, 
representing  decreasing  current  or  previous  path  costs,  for  each  state  X  that  is  or  was  on  the  OPEN  list.  Given  a 
sequence  of  states  (X,.X^} ,  state  X,.  is  an  ancestor  of  state  X^  if  l  s  i  <  j  s  W  and  a  descendant  of  X^  if  \^j<i^N. 

For  ail  two-state  functions  involving  the  goal  state,  the  following  shorthand  notation  is  used:  /(X)  =f(.G,X).  Likewise, 
for  sequences  the  notation  {X}  s  (GX)  is  used.  The  notation  /U)  is  used  to  refer  to  a  function  independent  of  its 
domain. 
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2J2.  Algorithm  Doscription 

Hie  D*  algorithm  is  presoited  in  this  section.  The  algmithm  consists  primaiily  two  functions:  PROCESS  -  STATE 
and  MODIFY- COST.  PROCESS-STATE  is  used  to  compute  c^idmal  i»ih  costs  to  the  goal,  and  MODIFY- COST 
is  used  to  change  the  me  cost  function  cC)  mid  enter  affected  states  on  the  OPEN  list.  Initially,  ((°)  NEW  for 

an  states,  MG)  is  set  to  zero,  and  C  is  {daced  on  the  OPEN  list.  The  first  routine,  PROCESS  -  STATE,  is  r^ieatedly 
called  imtil  the  robot’s  state,  X,  is  removed  firiHn  the  OPEN  list  (i.e.,  t(X)  =  CLOSED)  ex  a  value  of  -1  is  renuned,  at 
which  point  either  the  sequence  {X}  has  been  constructed  cff  does  not  exist  respectively.  The  robot  thoi  proceeds  to 
foUow  the  baclqpointers  in  the  sequence  {X}  until  it  either  teaci»s  the  goal  or  discovers  an  error  in  the  arc  cost 
function  cO  (e.g.,  due  to  a  detected  obstacle).  The  second  routine,  MODIFY  -  COST,  is  immediately  called  to  cwrect 
c(o)  and  place  affected  states  on  the  OPEN  list.  Let  K  be  the  rtdiot’s  state  at  which  it  discovers  an  error  in  cC) .  By 
calling  PROCESS -STATE  until  it  returns  k^i„^KY),  the  cost  changes  are  propagated  to  state  Y  such  that 
MY)  =  o(10  •  At  this  point,  a  possibly  new  sequence  {  Y)  has  been  constructed,  and  the  robot  continues  to  follow  the 
backpointers  in  the  sequence  toward  the  goal. 

The  algorithms  for  PROCESS  -  STATE  and  MODIFY-  COST  are  presented  below.  The  embedded  routines  are 
MIN -STATE,  which  returns  the  state  on  the  OPEN  list  with  minimum  t(“)  value  (NULL  if  the  list  is  empty); 
GET-  KMIN,  which  reUuns  for  the  OPEN  list  (-1  if  the  list  is  empty);  DELETE(X),  which  deletes  state  X  from 
the  OPEN  list  and  sets  t(X)  =  CLOSED-,  and  INSERT(X),  which  sets  i(X)  =  OPEN,  computes  MX)  from  h(X)  and 
p(X) ,  and  places  or  re-positions  state  X  on  the  OPEN  list  sorted  by  M")  ■ 

In  function  PROCESS  -  STATE  at  lines  LI  through  L4,  the  state  X  with  the  lowest  M")  value  is  removed  firom  the 
OPEN  list.  Before  X  increases  or  reduces  the  path  cost  of  its  neighbms,  it  first  checks  if  any  of  its  neighbors  can 
reduce  its  own  path  cost  at  lines  LS  through  Lll.  Note  that  the  check  is  limited  to  CLOSED  neighbors  with  optimal 
ft(”)  values  (i.e.,  less  than  or  equal  to  the  old  k„,„).  At  lines  L12  through  LS7  each  neighbor  of  X  is  examined  again. 
All  neighbors  that  receive  a  new  path  cost  are  placed  on  the  OPEN  so  fiiat  they  will  propagate  the  cost  change  to  their 
neighbors.  At  lines  LIS  through  L20,  the  path  cost  is  computed  firom  a  NEW  neighbor  K  to  the  goal.  The  backpointer 
is  set  to  X  so  that  the  monotonic  sequence  {  7}  is  constructed.  At  lines  L23  through  L32,  all  neighbor  states  Y  that 
have  a  backpointer  to  X  receive  a  new  path  cost,  regardless  of  whether  the  new  cost  is  greater  than  or  less  than  the 
old.  Since  these  states  are  descendants  of  X,  any  change  to  the  path  cost  (tf  X  affects  their  path  costs  as  well.  At  lines 
L36  through  L46,  state  X  reduces  the  path  cost  of  its  neighbors  (if  possible)  that  are  not  immediate  descendants  of  X 
and  redirects  their  backpointers  to  point  to  X.  Note  that  this  reduction  is  permitted  only  if  X  is  a  LOWER  state.  It  is 
shown  in  the  next  section  that  this  requirement  is  essential  to  avoid  creating  a  closed  loop  in  the  backpointers.  If  X  is 
a  RAISE  state,  it  is  placed  back  on  the  OPEN  list  for  future  expansion.  At  lines  L49  through  L53,  the  neighbors  Y  of 
X  that  are  able  to  r^uce  the  path  cost  of  X  are  placed  on  the  OPEN  list.  Since  these  neighbor  states  have  path  costs 
greater  than  the  old  dieir  path  costs  are  not  guaranteed  to  be  optimal.  Thus,  the  updating  is  “postponed”  until  the 
neighbors  are  selected  for  expansion,  at  which  time  they  will  be  optimal.  Finally,  at  line  LS9  the  current  is 
returned. 


Function:  cost:PROCESS-STATE  0 

LI  X  =  MIN -STATE  (  ) 

L2  if  X  =  NULL  then  return  -1 

L3  k^,j=  GET-KMIN() 

L4  DELETEiX) 

L5  #  Reduce  MX)  by  lowest-cost  neighbor  if  possible 

L6  for  each  neighbor  y  of  X : 

L7  if  t(Y)  =  CLOSED  and  h(Y)  S  k^^  and  h(X)  >  h(Y)  +  c(Y,  X)  then 

L8  MX)  =  Y 

L9  h(X)  =  h(Y)  +  c(Y,X) 

LIO  endif 

Lll  endfcxeach 
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U2 

L13 

L14 

L15 

L16 

L17 

L18 

L19 

L20 

L21 

L22 

L23 

L24 

L25 

L26 

L27 

L28 

L29 

L30 

L31 

L32 

L33 

L34 

L35 

L36 

L37 

L38 

L39 

lAO 

L41 

L42 

L43 

L44 

L45 

L46 

L47 

L48 

L49 

L50 

L51 

L52 

L53 

L54 


#  Process  each  neighbor  of  X 
for  ea<^  neighbor  Y  of  X: 

#  nropagaie  cost  U)  NEW  state 
if  i(y)  =  NEW  dien 
b(Y)  =  X 

HY)  =  fiCX)  +  c(X,Y) 

P(Y)  =  *(10 
INSERT\Y) 

endif 

else 

#  Propagate  cost  change  along  backpointer 
if  *(10  =  X  and  h(Y)*h(X)  +  c(X,  Y)  then 
if  f(i0  =  OPEN  then 

if  h{Y)<p(y)  then  p{Y)  =  *(10 
HX)  =  *(X)  +  c(X.10 

endif 

else 

m  =  m+c{x.  Y) 

P(y)  =  *(10 
endelse 
INSERTiX) 

endif 

else 

#  Reduce  cost  of  neighbor  if  possible 
if  b{Y)*X  and  *(10 > *(X)  +  c(X,  10  then 
ifp(X)s*(X)  then 
b{Y)  =  X 

h(Y)  =  *(X)  +  c(X,10 

if  1(10  =  CLOSED  then  p(Y)  =  *(10 

INSERTXY) 

endif 

else 

p(X)  =  *(X) 

INSERTVO 

endelse 

else 

#  Set  up  cost  reduction  by  neighbor  if  possible 
if  IKY)*X  and  *(X)  >  *(10  +  c(Y.  X)  and 

t(10  =  CLOSED  and  h(Y)>k^ij  then 
P(i0  =  KY) 

INSER1\Y) 

endif 


endelse 
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L55 

mdelse 

L56 

endelse 

L57 

otdfoteach 

L58 

#  Return*,;, 

L59 

return  GET-KMINi  ) 

L60 

ondfunction 

Id  functioD  MODIFY-  COST  at  line  L2,  the  arc  cost  function  is  updated  with  the  changed  value.  Since  the  path  cost 
for  state  Y  will  change,  X  is  placed  on  the  OPEN  list.  When  X  is  expanded  via  PROCESS -STATE,  it  computes  a 
new  A(y)  =  AfX)  -f  c(X,  Y)  and  places  Y  on  the  OPEN  list.  Additional  state  expansions  propagate  the  cost  to  the 
descendants  of  Y. 

Function:  cost:MODIFY-COST  (state:  X,  state:  Y,  cost:  cval) 

LI  #  Change  the  arc  cost  value 
L2  c{X,  Y)  =  cval 

L3  #  Insert  state  X  on  the  OPEN  list  if  it  is  CLOSED 
L4  if  r(X)  =  CLOSED  then 
L5  p(X)  =  KX) 

L6  INSERTXX) 

L7  endif 
L8  #  Return 

mill 

L9  KtamGET-XMINO 
LIO  endfunction 

2.3  illustration  of  Operation 

The  role  of  RAISE  and  LOWER  states  is  central  to  the  operation  of  the  algorithm.  The  RAISE  states  (i.e.,  MX)  >p(X)) 
propagate  cost  increases,  and  the  LOWER  states  (i.e.,  hpO^pPO)  propagate  cost  reductions.  When  the  cost  of 
traversing  an  arc  is  increased,  an  affected  neighbor  state  is  placed  on  the  OPEN  list,  and  the  cost  increase  is 
propagated  via  RAISE  states  through  aU  state  sequences  containing  the  arc.  As  the  RAISE  states  come  in  contact  with 
neighboring  states  of  lower  cost,  these  LOWER  states  are  placed  on  the  OPEN  list,  and  they  subsequently  decrease 
the  cost  of  previously  raised  states  where  ever  possible.  If  the  cost  ot  uaversing  an  arc  is  decreased,  the  cost  decrease 
is  {»opagated  via  LOWER  states  through  all  state  sequraices  containing  the  arc,  as  well  as  neighboring  states  whose 
cost  can  also  be  lowered. 

Hgcre  1  through  Hgure  7  illustrate  the  operation  of  the  algorithm  for  a  “potential  well”  path  planning  problem.  The 
planning  space  consists  of  a  SO  x  SO  grid  of  cells.  Each  cell  rejnesents  a  state  and  is  connected  to  its  eight  neighbors 
via  bidirecticnal  arcs.  The  arc  cost  values  are  small  fw  the  free  cells  and  prohibitively  laige  for  the  obstacle  ceils.  The 
robot  is  point-sized  and  is  equipped  with  a  contact  sensor.  Figure  1  shows  the  results  of  an  optimal  path  calculation 
firom  the  goal  to  all  states  in  the  planning  space.  The  two  grey  obstacles  are  stored  in  the  map,  but  the  black  obstacle 
is  not  The  arrows  depict  the  backpointer  function;  thus,  an  optimal  path  to  the  goal  for  any  state  can  be  obtained  by 
tracing  the  arrows  from  the  state  to  the  goal.  Note  that  the  arrows  deflect  around  the  grey,  known  obstacles  but  pass 
through  the  black,  unknown  obstacle. 

In  Figure  2,  the  robot  follows  the  backpointers  from  its  starting  location  at  the  center  of  the  left  wall  toward  the  goal. 
Its  path  is  depicted  by  the  horizontal  black  line.  When  it  reaches  the  uiflcnown  black  obstacle,  it  detects  a  discrepancy 
between  the  nuq)  and  the  world,  updates  the  map,  and  enters  the  state  on  the  OPEN  list  via  MODIFY- COST.  The 
cell  is  changed  to  grey,  indicating  that  it  is  now  known  to  be  an  obstacle.  PROCESS  -  STATE  is  called  to  compute  a 
new  path  to  the  robot.  The  state  containing  the  detected  part  of  the  obstacle  becomes  a  RAISE  state  that  passes  the 
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path  cost  increase  to  its  descendants  upon  expansion.  The  raise  states  place  Uk  upper  neighbor  of  the  detected 
obstacle  on  the  OPEN  list  as  a  lower  state.  This  neighbOT  redirects  the  robot  cell’s  baclqx^ter  up  and  to  the  right. 
When  the  robot  attempts  to  move  in  this  direction,  its  sensor  discovers  that  this  new  cell  is  also  an  obstacle. 
Successive  calls  to  MODIFY-  cost  and  PROCESS  -  state  lead  the  robot  up  along  the  unknown  obstacle  (see 
Hguie  3).Tbe  dark  grey  cells  in  the  center  of  the  well  are  raise  states,  and  the  light  grey  cells  are  lower  states. 
Note  that  the  lower  states  have  directed  the  backpointers  in  the  upper  half  of  the  well  to  point  toward  the  upper 
portion  of  the  unknown  obstacle. 

When  the  robot  reaches  the  mp  of  the  unknown  obstacle,  it  discovers  that  the  “gap”  is  sealed  (Figure  4).  raise  states 
propagate  this  information  through  the  upper  half  of  the  well,  and  then  LOWER  states  expand  ffrun  the  remaining, 
lower  pwtion  of  the  unknown  obstacle  to  redirect  backpointers  toward  the  lower  half  of  the  well.  The  robot  then 
moves  down  along  the  obstacle  to  the  lower  portion  of  the  well  and  discovers  that  the  entire  gap  between  the  two 
original  map  obstacles  is  sealed  (Figure  5).  Thus,  the  path  cost  to  all  cells  in  the  well  is  increased,  and  this 
information  is  propagated  via  RAISE  states  which  expand  out  of  the  well  to  the  left 

As  the  RAISE  states  move  out  of  the  well,  they  activate  LOWER  states  arouiKl  the  lip  which  proceed  to  sweep  into  the 
well  around  the  upper  atKl  lower  obstacles  (Hgure  6)  and  redirect  the  backpointers  out  of  the  well.  This  fuocess  is 
complete  when  the  LOWER  states  reach  the  robot’s  cell,  at  which  point  the  robot  moves  around  the  lower  obstacle  to 
the  goal  (Figure  7).  Note  that  after  the  traverse,  the  hadqiointers  are  only  partially  updated.  Backpointers  within  the 
well  point  outward,  but  those  in  the  left  half  of  the  planning  space  still  point  into  the  well.  All  states  have  a  path  to  the 
goal,  but  optimal  paths  are  computed  to  a  limited  number  of  states,  llus  effect  illustrates  the  efficiency  of  D*.  The 
backpointer  updates  needed  to  guarantee  an  optimal  path  fOT  the  robot  are  limited  to  the  vicinity  of  the  obst£K;le. 


Figure  1:  Bactqsointers  Based  on  Initial  Propagation  from  Goal  State 
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Figore  2:  Robot  Discovere  First  Unknown  Obstado  CeN 


Figure  3:  Robot  Moves  Up  in  Search  of  Path  around  Obstacle 
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Figorc  6:  LOWER  States  Sweep  into  Well 


F^ure  7:  Final  Backpointer  Ck>nfiquration  after  Robot  Reaches  Goal 
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3.0  Proofs  of  Soundness,  Optimality,  and  Completeness 

After  all  states  X  have  been  initialized  to  t(X)  =  NEW  and  G  has  been  entoed  onto  the  OPEN  list,  the  function 
PROCESS  -  STATE  is  repeatedly  invoked  to  construct  state  sequences.  The  function  MODIFY-  COST  is  invoked  to 
make  changes  to  c(”)  and  to  seed  these  changes  on  the  OPEN  list  In  this  section,  D*  is  shown  to  have  the  following 
properties; 

Property  1;  If  ((X)  *  NEW,  then  a  sequence  {X}  is  constructed  and  is  monotonic. 

Property  2:  When  the  value  returned  b>  .'ROCESS- STATE  equals  or  exceeds  h{X),  then 
/i(X)  =  <KX). 


Property  3:  If  a  path  from  X  to  G  exists,  and  the  search  space  contains  a  finite  number  of  states, 
then  {X}  will  be  constructed  after  a  finite  number  of  calls  to  PROCESS  -  STATE.  If  a  path  does 
not  exist,  then  PROCESS  -  STATE  will  return  -1  with  «(X)  =  NEW. 

Property  1  is  a  soundness  property:  once  a  state  has  been  visited,  a  finite  sequence  of  backpointers  to  the  goal  has 
been  constructed.  Property  2  is  an  optimality  property.  It  defines  the  conditions  under  which  the  chain  of  backpointers 
to  the  goal  is  optimal.  Property  3  is  a  cmnpleteness  property:  if  a  path  from  X  to  G  exists,  it  will  be  ctmstructed.  If  no 
path  exists,  it  will  be  reported  in  a  finite  amount  of  time.  All  three  properties  hold  regardless  of  the  pattern  of 
invocation  for  functions  MODIFY- COST  and  PROCESS -STATE. 

In  order  to  prove  that  O'"  has  the  above  properties,  a  number  of  thetuems  are  needed  to  lay  the  groundwork.  As  D* 
propagates  costs,  it  redirects  backpointers  in  such  a  way  as  to  create  new  and  optimal  state  sequences.  The  first  gi  jup 
of  theorems  defines  the  conditions  under  which  backpointers  can  be  modified  and  still  preserve  Property  1.  Theorem 
1  establishes  the  uniqueness  of  a  state  sequence. 

Theorem  1:  If  each  state  has  only  one  backpointer,  only  one  sequence  {X,  can  exist  between 
any  two  states  X,  and  X^. 

Proof:  Let  be  another  sequence  from  X,  to  X^.  Clearly,  must  be  X^y  since  the 

sequences  must  end  at  the  same  state.  Y„_  ^  must  be  X^_  j  urdess  Y^,  or  has  two  backpointers. 

By  induction,  the  sequences  must  be  identical  down  to  and  including  state  Xj .  If  {XjX^}  and 
are  of  different  lengths,  then  either  the  longer  sequence  does  not  end  at  Xj  or  it  contains 
multiple  copies  of  Xj ,  thus  violating  the  definition  of  a  sequence.  QED. 

Theorem  2  defines  the  condition  under  which  a  state  can  be  cut  off  fimn  the  goal.  If  the  backpoint^*  of  an  ancestor  of 
state  X  is  redirected  to  point  to  X  or  one  of  its  descendants,  then  a  cycle  in  the  backpointers  is  introduced  in 
sequences  that  contain  X. 

Theorem  2;  Assume  that  Property  1  holds  for  a  given  set  of  states.  Given  the  sequence  {GX] ,  let  y 
be  the  set  of  states,  such  that  l'€  y  if  the  sequence  {X.K}  exists.  If  h(X)  is  set  to  some  state  in  y , 
then  no  sequence  {G,Y}  exists  for  a  state  Yiff  Ye  y. 

Proof:  If  Y^  e  y,  then  any  sequence  {G.X,}  must  contain  the  subsequence  {GX}  (by  the  definition 
of  y  and  Theorem  1).  But  if  h<X)  is  redirected  to  point  to  a  member  of  y,  then  (G.X}  must  coma*. 

X  again.  This  violates  the  definition  of  a  sequence.  Therefore,  all  states  Ye  y  will  not  have  valid 
sequences.  Since  only  b(X)  is  redirected,  any  states  which  are  not  members  of  y  are  unaffected,  and 
Property  1  still  holds  for  these  states.  QED. 

One  way  to  avoid  a  cycle  when  redirecting  the  backpointer  of  state  Y  to  point  to  X  is  to  determine  whether  or  not  Y  is 
an  ancestor  of  X.  Theorem  3  establishes  a  necessary  condition  for  this  determination  by  capitalizing  on  the 
monotonicity  of  state  sequences  under  Property  1. 


Theorem  3:  Assume  that  Property  1  hokis  for  a  given  set  of  states.  Given  a  monotonic  sequence 
aidastaie  Z  with  a(Z)>  A(X^),  Z  cannot  be  a  member  of  unless  contains 

at  teak  <»e  RAISE  state. 

Proof:  Assume  Z  is  a  member  and  iXj  contains  no  RAISE  states.  For  any  pair  of  adjacent 
states  Xj  and  X^^j  in  the  sequence,  if  HX)  =  CLOSED,  then  a(Xf)<A(Xj^i)  by  definition.  If 
/(Xj)  =  OPEN,  then  p(,X)<h^X^^^).  But  since  X,  must  be  a  LOWER  state,  then  fc(Xp  S/KX^),  and 
therefore  hOC)<hQLi^^-  Therefore,  by  induction  and  transitivity  of  the  inequality  relation, 

A(Xj)  <  A(Xjy)  fcff  all  i  such  that  l  £  i  <  A^.  So  by  contradiction,  either  Z  is  not  a  member  or  the 
sequence  contains  a  RAISE  slate.  QED. 

Ihe  following  theoim  strengthens  the  condition  on  the  RAISE  state  for  determiitiog  state  ancestry  by  establishing  a 
relational  test  on  its  value. 

Theorem  4:  Assume  the  sequence  {X^X^}  is  mcmotonic.  If  any  of  the  elements  X,  through  Xff_ , 
are  RAISE  states,  then  for  at  least  one  of  these  RAISE  states  X^,  k(X^  <  h(Xfj) . 

Proof:  Assume  that  j}  contains  at  least  one  RAISE  state,  and  let  Xj  be  the  RAISE  state 

with  the  largest  index.  Therefore,  the  subsequence  (Xj^^Xj^l  contains  no  RAISE  states.  By  the 
definition  of  amonotonic  sequence,  A(Xj)<A(Xj^i)  for  all  i  such  that  S<i<N.  Therefore,  by 
induction  and  transitivity  of  the  inequality  lelatitHi,  ACX^^ ,)  ^  A(X^) .  (Equality  of  the  AC)  values 
occurs  when  £+1  =  N.)  Since  X^  is  a  RAISE  state,  then  ikx^)  =  p(X^)<h(X^^i);  thus, 
A(X5)<A(X^).QED. 

Therefore,  by  redirecting  badqwinters  only  to  states  with  AC)  less  than  or  equal  to  the  minimum  AC)  on  the  OPEN 
list,  it  is  impossible  to  create  a  baclqxrinter  cyde.  This  is  formalized  in  Tbemem  S. 

Theorem  5:  Assume  that  Property  1  holds  for  a  given  set  of  states.  Let  X  be  a  state  such  that 
A(X)  S  Let  Xf  be  a  nei^bor  state  of  X  such  that  c{X,  xp  is  defined  and  A(X)  <  A(X,) .  If  A(Xj)  is 
set  to  X,  that  Property  1  is  preserved. 

Proof:  Consider  the  two  cases:  1)  X,.  is  not  a  member  of  the  sequence  {GX} ;  and  2)  X,  is  a  member. 

Case  1:  Since  X  is  not  a  descmlant  of  Xj,  then  sequences  exist  for  all  states  with  tC)  *  NEW  after 
the  backpointer  is  redirected  (Theorem  2).  Since  the  sequoice  {GX}  is  monotonic,  A(X)  <  A(Xj),  and 
all  sequences  beginning  with  X,-  are  monotonic  (Property  1),  then  all  resultant  sequences  are 
monotonic.  Case  2:  Since  A(X)  is  less  than  or  equal  U>  the  minimum  AC”)  value  on  the  OPEN  list, 
then  firtan  Theorem  4,  no  membos  of  the  sequence  (GX)  can  be  RAISE  states.  But  from  Theorem 
3,  if  no  members  ate  RAISE  states,  then  X^  cannot  be  a  member  of  {G,X}  unless  A(X)  2  A(Xj) .  But, 

A(X)  <  A(Xj),  so  case  2  cannot  exist  QED. 

In  addition  to  theorems  governing  the  modification  of  &(”),  a  theorem  goventing  modifications  to  A(0)  is  needed  to 
preserve  monohmicity  of  the  sequences  as  required  under  Prqierty  1. 

Theorem  6:  Assume  that  Property  1  holds  for  a  given  set  of  states.  Consido:  two  states,  X  and  Y, 
such  that  b(Y)  =  X.  The  following  modifications  can  be  made  to  h{Y)  while  still  preserving 
Property  1.  If  =  OPEN,  then  A(IT  can  be  modified  to  assume  any  value  provided  that 
h{Y)>p(X)  if  /(A)  =  OPEN  and  h{Y)>h{Xi  if  r(X)  =  CLOSED.  If  t(Y)  =  CLOSED,  then  HY)  can 
be  adjusted  if  it  satisfies  the  same  lower  bound  constraints  and  is  also  not  increased. 

Proof:  Let  y  be  the  set  of  states  such  that  Y^ey  iff  b{Y)  =  Y.  Consider  the  case  where 
t(X)  =  OPEN.  Fran  the  definition  of  a  monotonic  sequence,  pIy)  must  be  less  than  AlF,)  fa  all  Y- 
in  y.  Modifying  M.Y)  does  not  affect  p(f),  so  the  condition  still  holds.  From  the  definition  of  a 
monotonic  sequence,  the  value  of  h(Y)  must  be  greater  than  pfX)  if  X  is  OPEN  and  greater  than 
A(X)  if  X  is  CLOSED,  but  these  conditions  are  stated  in  the  theorem.  Consider  the  case  where 
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t(Y)  =  CLOSED.  From  the  definition  of  a  monotonic  sequence,  h{Y)^h{y^  for  all  y,  in  y. 
Decreasing  hty)  preserves  this  condition,  [Movkled  HX)  satisfies  the  lower  bound  constraints  stated 
^ve  for  the  same  reasons.  Thus,  all  sequences  remain  monottHiic  and  Propmy  I  holds.  QED. 

A  corollary  cm  be  derivnl  for  modifications  to  pC) . 

Corollary  6:  Assume  that  Property  1  holds  for  a  set  of  states.  Given  a  state  X  such  that 
$(X)  =  OPEN,  if  p(X)  is  reduced  then  is  Property  1  preserved. 

Proof;  See  the  {voof  to  Theorem  6.  Since  p<X)  has  an  ui^  bound  but  no  lower  bound,  it  can  be 
reduced  and  Pir^)erty  1  sdll  holds.  QED. 

A  similar  theorem  governing  modifications  to  !(<*)  is  needed  to  preserve  sequence  monotonicity  under  Property  1 . 

Theorem  7:  Assume  that  Property  1  holds  for  a  given  set  of  states.  If  r(X)  is  changed  from  OPEN 
to  CLOSED,  Property  1  is  preserved  if  /i(X)  Sp(X).  If  r(X)  is  changed  from  CLOSED  to  OPEN, 
Property  1  is  preserved  if  p(X)  5  /i(X)- 

Proof:  Consider  the  case  where  r(X)  is  set  to  CLOSED.  Let  x  be  the  set  of  states  such  that  X-  €  x  iff 
biXi)  -  Before  closure,  p(X)  must  be  less  than  h(X)  for  all  X,.  in  x,  and  after  closure,  k(io  must 
be  less  than  h(X^)  for  all  X^  (definition  of  a  monotonic  sequence).  Thus,  if  k(X)ip(X),  then 
MX)  !Sp(X)  <h(Xj)  for  all  X,-  in  x  and  the  theorem  holds.  Consider  the  case  where  t(X)  is  set  to 
OPEN.  If  p(X)  £  hiX),  then  p(X)  i  MX)  <  A(Xp  for  all  Xj  in  x  and  the  theorm  holds.  QED. 

The  sunxirting  theorems  are  now  in  place  to  {Hove  that  D*  preserves  Property  1  in  all  cases. 

Theorem  8:  D*  preserves  Pr(^)erty  1. 

Proof:  The  portions  of  PROCESS  -  STATE  and  MODIFY  -  COST  that  modify  the  functions  M*) , 

M*)>  p(*).  ^  K")  need  to  be  examined.  In  PROCESS-STATE  at  line  L4,  X  is  removed  Grom  the 
OPEN  list.  It  is  shown  below  that  Property  1  is  preserved  by  modifying  the  M*)  values  of  states 
with  backpointers  to  X.  At  line  L8,  MX)  is  redirected.  Since  h[Y)  s  s and  MD  <  M*) •  then 
by  Theorem  5  Propmy  1  is  preserved.  At  line  L9,  h(X)  is  modified.  From  the  conditional,  h(X)  is 
modified  only  if  it  can  be  d^eased,  and  after  modificatitxi,  h(X)  >  MD  ■  Since  both  X  and  Y  are 
CLOSED,  from  Theorem  6  Property  1  is  preserved.  At  line  L16,  MD  is  assigned.  Since  rff)  is 
NEW,  it  was  not  previously  part  of  a  sequence,  and  after  the  assignment  of  MD .  y  is  the  last  state 
in  the  sequence.  At  line  L17,  Mf)  is  assigned  such  that  MD  >MX),  thus  preserving  Property  1.  At 
lines  L18  and  L19,  Y  is  inserted  onto  the  OPEN  list.  Since  no  other  states  have  baclqx>inters  to  Y, 
then  p{Y)  can  assume  any  value,  and  Property  1  is  preserved.  At  lines  L26  and  L29,  MD  is 
modified  so  that  it  is  greater  than  MX)  for  all  Y  such  diat  M7)  =  X,  thus  restoring  monotonicity 
possibly  lost  firom  the  removal  of  X  finom  the  OPEN  list  at  line  LA.  At  line  L2S,  p{Y)  is  reduced. 

From  Corollary  6,  Property  1  is  preserved.  At  line  L32,  y  is  inserted  or  rqrasitioned  on  the  OPEN 
list.  If  t{Y)  is  changed  to  OPEN,  then  since  p(Y)  =  MD.  fi^m  Theorem  7  Property  1  holds.  At  line 
L38,  Ml)  is  redirected.  Since  MX)  =  and  h{X)<h{Y),  then  by  Theorem  5  Property  1  is 

preserved.  At  line  L39,  since  Ml)  is  reduced.  Ml)  >  A(X),  and  X  is  either  CLOSED  or  OPEN  with 
p(X)  =  h(X)  (lines  L44  and  L45),  then  fiom  Theorem  6  Property  1  is  preserved.  At  line  L41,  y  is 
insmed  or  repositioned  on  the  OPEN  list.  For  the  same  reason  as  line  L32,  Property  1  holds.  At 
lines  L44  and  L45,  X  is  placed  back  on  the  OPEN  list  Since  p(X)  =  k(X),  then  from  Theorem  7 
Property  1  is  preserved.  For  the  same  reason.  Property  1  is  jneserved  when  y  is  placed  back  on  the 
OPEN  list  at  lines  LSI  and  LS2. 

The  function  MODIFY-  COST  affects  r(®)  but  does  not  modify  M").  or  p(®).  Note:  p(”)  is 
assigned  but  not  changed.  At  line  L6,  the  CLOSED  state  X  is  placed  on  the  OPEN  list.  Since  p(X) 
is  set  to  MX) ,  then  from  Theorem  7  Property  1  is  preserved.  QED. 
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Thus,  Theorem  8  proves  that  D*  will  not  “cut  off'  a  state  X  from  the  goal  once  the  sequence  iGJf}  has  been 
constructed.  The  sequence  may  be  modified  later,  but  at  all  times  it  is  possible  to  trace  backpointers  from  X  to  G. 
Thus,  D*  generates  only  sound  sequoices.  This  pn^ity  is  important  for  moving  the  robot  toward  the  goal  before 
information  has  been  folly  propagated  through  the  set  of  states. 

The  (^timality  of  D*  is  shown  next,  as  stated  in  Property  2.  The  first  thetn-em  addresses  the  relationship  between 
suues  on  and  off  the  OPEf/  list  Figure  8  illustrates  die  possibte  combinaticnis  and  transitions  fcv  tte  >(”)  values  of  a 
pair  of  neighbcHT  states  X  and  Y. 


Figure  8:  Possible  transitions  for  states  X  and  Y 


After  the  stat '  X  and  Y  are  initialized,  they  are  both  labelled  NEW,  as  shown  in  box  SI.  Since  a  state  tag  cannot  be 
set  to  NEW  again  after  initialization,  box  SI  cannot  be  re-entered  (as  shown  by  the  arrows).  The  dangling  arrow 
points  to  isomorphic  copies  (not  shown)  of  boxes  S2  through  S6  with  X  and  Y  swapped.  Box  S2  represents  the 
placement  of  X  on  the  OPEN  list,  after  which  y  can  be  opened  (S3)  or  X  can  be  clos^  (S4).  The  two  states  can 
transition  between  S3,  SS,  and  S6  as  the  states  are  individually  inserted  and  deleted  from  the  open  list  Again,  the 
dmigling  pointos  from  S3  and  S6  point  to  a  box  isomorphic  to  SS. 

Using  this  state  transition  diagram,  a  theorem  about  the  relationship  between  cost  values  for  states  in  box  SS  is  proved 
below. 


Theorem  9:  Given  any  two  states,  X  and  Y,  such  that  c(X,  Y)  is  defined,  t[X)  ~  CLOSED,  and 
t(X)  =  OPEN,  then  *(1)  s  h(X)  +  c(X,  Y) . 

Proof;  Initially,  X  and  Y  are  NEW  states  as  shown  in  box  SI.  Since  X  and  Y  can  be  opened  by 
diff^nt  states,  no  assumptions  are  made  about  their  li('’)  and  it(°)  values  in  the  transition  through 
box  S2  to  S3.  In  the  transition  from  S2  through  S4  to  SS,  X  is  CLOSED  and  Y  is  placed  on  the 
OPEN  list.  This  transition  occurs  at  lines  LIS  through  L19  in  PROCESS -STATE.  In  this  segment, 
k(y)  =  KY)  is  set  to  h(X)  +  c(X,  Y),  thus  the  theorem  holds.  In  the  transition  from  S3  to  SS,  X  is 
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CLOSED  and  Y  remains  OPEN.  Consida  the  two  cases:  1)  b{Y)  =  X\  and  2)  b(Y)*X.  Case  1:  At 
lines  L23  through  L32,  hUX)  is  set  to  A(X) -»■  cCX,  iO  andJt(}0£/i(l^;L’.us,  the  thewem  holds.  Case  2: 
Consider  two  subcases:  2a)  X  was  a  LOWER  state:  and  2b)  X  was  a  raise  state.  Case  2a:  At  lines 
L37  through L41,  if  hiy)^h!Xi  +  cOL  Y),  then  since  k(,Yiih(Y)  and  no  action  is  taken  the  tfaewem 
holds.  If  li(Y)>h(X)  +  c(X,  f).  then  h(Y)  is  set  equal  to  h(X)  +  c{X  Y).  Since  k(Y)^k(Y),  the  thewem 
holds.  Case  2b:  If  h(,Y)  >  k(X)  -t-  c(X,  f)>  then  X  is  placed  back  on  the  OPEN  list  at  lines  L44  and 
L4S.  and  X  and  Y  are  transitioned  back  to  box  S3.  In  box  SS,  it  is  possiUe  for  a  state  other  than  x 
to  modify  KY).  Since  reducing  KY)  can  only  reduce  i^Y),  only  ttose  modifications  that  increase 
h(Y)  are  of  concern  (lines  L2S  and  L26).  In  this  segment,  p(Y)  is  reassigned  in  (uder  to  prevent  k(Y) 
fitun  increasing,  and  the  theorem  holds. 

In  the  transition  from  S5  to  S6,  consider  three  cases:  1)  an  immediate  transition  is  made  within 
PROCESS  -  STATE  from  S6  back  to  SS;  2)  an  immediate  transition  is  made  from  S6  to  the  box 
istmunphic  to  SS;  and  3)  the  states  remain  in  S6.  C!ase  1:  At  lines  L44  and  L4S,  Y  is  placed  back  on 
the  OPEN  list  with  k{Y)  =  li(Y)  after  a  possible  reduction  of  h(Y)  at  lines  L7  through  L9.  Since  k{Y) 
can  only  be  reduced,  k(Y)  i  h(X)  +  c(X,  Y)  and  the  theorem  holds.  Case  2:  Y  is  closed  and  X  is 
opened.  At  lines  L29  through  L32  and  L36  through  L41,  k(X)  is  set  to  h(Y)  +  c(Y,X)  and  the 
tteorem  holds.  At  lines  L49  through  LS2,  k(X)  is  set  to  A(X).  Since  h(Y)  >  h(X)  +  c(X,  Y),  then 
/t(X)  =  A(X)  <  h(Y)  -  c(X,  Y)  <  A(y)  +  c(Y,  X)  and  the  theorem  holds.  Case  3;  The  only  segment  of 
PROCESS  -  STATE  that  leaves  both  states  CLOSED  is  lines  L7  through  L9.  If  h[Y)  exceeds  k(X) 
by  mote  than  c(X,  Y),  then  h(Y)  is  set  to  /i(X)  +  c(X,  I);  thus,  h(Y)  s h(X)  +  c{X,  Y) .  Note  also  that 
k(X)  ^  h{Y)  +  c(y;  X) ;  otherwise,  Xot  Y  will  be  placed  on  the  OPEN  list  at  lines  L23  through  LS2. 
and  tlm  states  will  transition  out  (rf  S6.  In  the  transition  from  S6  bade  to  SS,  K  is  placed  back  on  the 
OPEN  list,  then  k(Y)  =  h(Y)  s  h(X)  +  c(X,  Y)  and  the  theorem  holds.  If  the  transitiem  is  made  from  S6 
to  the  isonunphic  box  to  SS,  then  it(X)  =  k(X)  i  h(Y)  +  c(X,  X)  and  the  theory  holds. 

This  last  case  is  inqiortant  for  analyzing  the  effects  of  function  MODIFY  -  COST.  This  function  is 
able  to  change  a  state  from  CLOSED  to  OPEN.  Since  box  S4  is  only  a  temporary  transition  within 
PROCESS -STATE,  it  cannot  be  affected  by  MODIFY -COST.  MODIFY -COST  can  effect 
transitions  from  SS  to  S3,  but  the  theorem  states  nothing  about  these  transitions.  The  only 
applicable  transitions  are  S6  to  SS  and  the  box  isomorphic  to  SS.  Since  h(Y)  ^  A(X)  -i-  c(X;  Y)  for 
states  in  S6  (see  above),  if  K  is  placed  tm  the  OPEN  list,  tbra  ki,Y)  h(.X)  +  c(X,  Y)  and  the  theorem 
holds.  This  operation  occurs  at  lines  L5  and  L6  of  MODIFY-  COST.  Ihe  same  reasoning  ^lies  to 
the  transition  from  S6  to  the  isomorphic  box  to  SS.  QED. 

Theorem  9  is  very  powerful,  because  it  proves  that  CLOSED  neighbors  of  an  OPEN  state  cannot  reduce  the  k(”) 
value  of  the  OPEN  state.  The  following  viorollary  derived  from  the  proof  for  the  previous  theorem  describes  the 
relafiODship  between  kC)  values  for  aneigubiuing  pair  of  CLOSED  states. 

Condiary  9:  (jivra  two  states  X  and  Y  such  that  t(X)  =  t{Y)  =  CLOSED,  if  c(Y,  X)  is  defined,  then 
A(X)  s  h(Y)  +  c(y,  X) ,  and  if  c(X,  Y)  is  defined,  tte^  ,i(Y)  Sh(.X)  +  c(XY). 

Proof:  See  the  proof  for  Theorem  9.  QED. 

I^om  TiMaem  9,  the  monotonicity  of  the  parameter  is  proved  in  the  theorem  below. 

Theorem  10:  Between  calls  to  MODIFY-  COST,  the  parameter  increase*:  or  remains  at  the 
same  value  a  finite  numbo'  of  times  with  each  invocation  of  PROCESS  -  STAl  e. . 

Proof:  Let  X  be  the  next  state  to  be  removes  •! .  OPEN  list;  therefore,  jfe(X)  =  .  It  will  be 

shown  that  X  can  only  insot  or  reposition  states  on  the  OPEN  list  to  have  values  greater  than 
k(X) .  Since  there  are  a  finite  number  of  states  on  the  OPEN  list  with  ^°)  values  equal  to  fc(X),  then 
^mifi  increase  or  remain  the  same  for  a  finite  number  of  iterations.  At  lines  L7  through  L9  in 
PROCESS  -  STATE,  A(X)  can  be  reduced.  Since  Y  is  CLOSED,  the  value  of  MX)  cannot  be 
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tediiced  below  HX)  (Tbeofem  9).  At  Unes  LIS  through  L19,  K  is  inseiled  onto  the  OPEN  list.  Since 
I^Y)  »  hUX)  »  h(X)*c(X,  the  theorem  holds.  At  lines  L23  through  L32,  Y  is 

inserted  or  rqxJsitioBed  on  the  OPEN  list  Consider  the  case  where  Y  is  already  mi  the  OPEN  list. 
Reasagning  the  value  of  KY)  can  only  reduce  lc(Y)  or  leave  it  unmodified.  If  KY)  is  reduced,  then 
k(Y)  =  hiY)  s  h(X)  +  c(X,  y)>h(X)2it(X)  and  the  tbeormn  bolds.  If  the  value  of  k{Y)  is  unmodified, 
then  either  it  was  already  greater  than  t(X)  m  was  equal  to  it,  and  the  theorem  holds.  Cmisider  the 
case  where  Y  is  inserted  onto  the  OPEN  list  For  the  same  reascms  as  lines  LIS  through  L19,  the 
theorem  hokis. 

At  lines  L37  through  L41,  Y  is  inserted,  rqxisitioned,  or  left  in  the  same  place  on  the  OPEN  list 
Since  p(X)  ^  A(X).  then  MX)  =  MX).  Since  after  modification  MY)  is  greater  than  MX),  if  Y  is 
inserted  onto  the  OPEN  list,  then  l<y)  =  MY)  >  MX)  =  MX)  and  the  theorem  holds.  If  K  is  already 
on  the  OPEN  list,  then  either  p(y)  is  less  than  the  modified  My)  and  K  is  not  repositioned,  or  p(Y) 
is  greater  than  or  equal  to  My)>  and  MY)  =  MY)',  thus,  the  theorem  holds  for  the  above  reasons.  At 
lines  L44  and  L4S,  X  is  re-inserted  on  the  OPEN  list.  Since  p(X)  <  MX)  before  re-insertion  and 
p(X)  =  MX)  after  le-insertion,  thm  MX)  must  increase  and  the  theorem  holds.  At  lines  L49  through 
L52,  Y  is  inserted  onto  the  OPEN  list.  Since  MY)  =  MY)>k^ij  =  MX),  the  theorem  holds.  QED. 

Now  that  the  monotonicity  of  has  been  established,  the  inductive  step  for  optimality  can  be  constructed.  It  is 
shown  below  that  if  states  with  h  (*)  values  less  than  or  equal  to  at  the  i-th  invocation  of  PROCESS  -  STATE  are 
optimal,  then  states  with  hC)  values  less  than  or  equal  to  the  new  at  the  (i-i-l)-st  invocation  of 
PROCESS  -  STATE  are  qitimal. 

Theorem  11:  If  MX)  =  MX)  for  all  states  X  such  that  MX)  then  MY)  ~  o(Y)  for  all  states  Y 
suchthat*^,^S/»(F)S*„i,. 

Proof:  A  state  Y^,  such  that  k^ijiMY)^k„j^  must  be  either  1)  CLOSED  or  2)  OPEN  with 
MY^  -  Order  the  states  Kj  by  *(“)  value  such  that  <t„,jSA(J',)sA(l'2)i...  ^MYff)i■k^^„. 

Consider  Xj  first.  Case  1:  From  the  premise,  A(Z)  s  mZ)  for  all  neighbor  states  Z  (i.e.,  c<Z,  Xj)  is 
defined)  such  that  A(Z)  <  A(Xj) .  Bom  Corollary  9,  none  of  these  optimal  neighbor  states  can  reduce 
A(Xj) .  Nor  can  any  neighbor  states  on  the  OPEN  list  reduce  A(X,),  since  the  h  (”)  values  for  states 
on  the  OPEN  list  are  greatm*  than  or  equal  to  These  OPEN  states  cannot  reduce  each  other’s 
MV  values  below  nm  can  their  CLOSED  neighbors  (Theorem  9).  Thus,  since  A(Xj) 
then  A(X,)  =  <7(Xj).  Case  2:  Since  MX,)  =  MX,),  then  fixMn  Theorem  9,  a  neighbor  state  X  with 
MX)  =  MX)  <  MX,)  cannot  reduce  A(X,) .  Thus,  MX,)  =  o(X,) .  The  above  argument  can  be  repeated 
for  the  remaining  states  in  order,  and  by  induction,  A(Xj)  =  o{Yd  for  i  =  2  through  i  =  N.  QED. 

The  monotonicity  of  k^-^  established  in  Theorem  10  crmibined  with  the  inductive  step  established  in  Theorem  11  is 
used  below  to  prove  the  optimality  of  O'*  as  given  in  Property  2,  regardless  of  the  calling  sequence  of 
PROCESS -STATE  and  MODIFY-  COST. 

Theorem  12:  D*  preserves  Prqroty  2. 

Proof:  Initially,  the  goal  state  G  is  placed  on  the  OPEN  list  with  A(G)  =  o(G)  =  0.  There  are  no 
CLOSED  states  since  f(®)  =  NEW  for  all  states  except  C.  When  PROCESS  -  STATE  removes  and 
expands  a  state  from  the  OPEN  list,  k^^  is  set  to  and  is  increased  monotonically 
(Theorem  10).  From  Theorem  11,  for  the  states  X  such  that  A(X)  A(X)  =  o(X); 
therefcne,  MX)  =  MX)  if  A(X)SA„,„. 

Assume  that  c(X,  X)  is  modified,  and  the  change  is  seeded  via  MODIFY-  COST.  If  X  is  OPEN, 
then  the  change  to  MX,  Y)  cannot  affect  optimality  of  states  with  MV  less  than  or  equal  to  k^-„, 
since  A(X)  can  be  reduced  no  lower  than  (Theorem  9).  Since  MX)  +  MX,  X)  must  be  greater  than 
kmi„,  then  MV  values  equal  to  or  lower  than  cannot  be  reduced;  thus,  the  pronise  to  Theorem 
11  is  still  true  and  PROCESS  -  STATE  can  be  invoked  to  propagate  the  modification.  If  X  is 
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CLOSED,  then  MODIFY-  COST  ensures  that  s  KX)  by  placing  x  on  the  OPEN  list.  This 
tqiefatkxi  preserves  the  truth  of  the  premise  to  Tbecrem  11.  since  reducing  selecu  a  subset  of 
the  optimal  CLOSED  states.  Thus,  Property  2  is  preserved  regardless  of  the  pattern  of  cost 
modificatioo  and  pcq»gation.  (^D. 

The  Uieoran  below  shows  that  D*  finds  amonotcMiic  sequence  to  any  state  X  that  is  reachable  from  the  goal. 
Theorem  13:  D'*  preserves  Pitqwrty  3. 

Proof:  Assume  that  a  state  Xf,  is  reachable  from  the  goal  (i.e.,  {X^Ji^J|,}  exists,  where  G  =  x^). 

Initially,  G  is  placed  <m  the  OPEN  list.  When  stme  X,-  is  expanded,  it  places  or  repositions  on 
the  OPEN  list  and  redirects  its  baclqtointer  if  necessary  (li^  LIS  through  L19,  L23  through  L32. 
and  L37  through  L41  in  PROCESS  -  STATE).  By  induction,  the  sequence  {X|.Xj^}  will  be 
constructed  unless  stune  state  X^  exists  in  the  sequeitce  (X,  such  that  i(X^  =  OPEN,  and  X^  is 
never  selected  for  expansion.  Once  a  state  X^  has  been  placed  on  the  OPEN  list,  its  !:(”)  value 
cannot  be  increased,  since  all  modifications  to  hf*)  for  OPEN  states  are  reductions.  Lines  L24 
through  L26  are  the  exception,  where  pC)  is  reassigned  to  i»event  if*)  from  increasing.  Thus,  due 
to  the  monotonicity  of  k^^^  (Theorem  10),  X^  will  be  eventually  removed  from  the  OPEN  list. 

If  a  state  Xff  is  unreachable  from  the  goal,  eventually  all  reachable  states  will  be  placed  on  the 
OPEN  list  (via  lines  LIS  through  L19  in  PROCESS  -  STATE)  and  will  be  removed  given  the  above 
reasoning.  Since  the  number  of  search  states  is  finite,  the  list  will  empty  after  a  finite  number  of 
calls  to  PROCESS -STATE,  and  -1  will  be  returned  with  /(Xj^)  =  NEW.  QED. 

The  significance  of  the  results  in  this  section  is  that  when  PROCESS  -  STATE  visits  a  state  X  (i.e.,  t(X)  *  NEW),  it 
constructs  a  sequence  {X}  to  the  goal.  Thereafter,  a  sequence  is  maintained  regardless  of  subsequent  arc  cost 
modifications  and  (Hopagation.  If  PROCESS  -  STATE  returns  -1  before  X  is  visited,  then  no  path  exists  from  X  to  the 
goal.  If  PROCESS -STATE  1$  invoked  repeatedly  until  is  greater  than  or  equal  to  A(X),  then  the  optimal 
sequence  {X}  to  the  goal  has  been  found.  Ihe  possible  uses  of  D*  for  mobile  robot  path  planning  are  discussed  in  the 
next  section. 
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4.0  Motion  Planning  Applications 

In  this  section,  D*  is  used  to  solve  a  number  of  problems,  beginning  with  a  simple  indoor  mobile  robot  path  planning 
problem  and  then  extending  to  more  difficult  and  relevant  planning  problems.  All  of  the  examples  in  this  section  were 
generated  using  an  implementation  of  O'*. 

4.1  Simpln  Path  Planning 

For  all  of  the  path  planning  problems  in  this  section,  the  environment  model  is  an  8-connected  cartesian  lattice  or  grid 
of  cells  as  shown  in  Figure  9.  Note  that  O’*  is  not  limited  to  this  representation;  instead,  it  requires  only  that  the  plan¬ 
ning  space  be  a  grtqih  of  states.  A  state  is  defined  to  be  the  center  of  a  ceil  in  the  lattice.  Fen-  a  given  state  X,  c(X^,  X)  is 
d^ned  for  i  =  1  to  8 .  Thus,  it  is  possible  to  move  from  state  X  to  neighboring  states  whose  cells  share  an  edge  or 
comer  in  the  lattice.  The  arc  cost  of  moving  from  X  to  X,  is  defined  to  be  equal  to  the  cost  of  moving  from  X,  to  X; 
thus,  c(X,  Xf)  =  c(Xj,  X) .  Let  function  r(X)  be  the  presumed  cost  of  traversing  the  width  of  the  cell  contaiiting  state  X, 
and  let  function  tdX)  be  the  actual  cost  of  traversing  the  cell.  From  the  figure,  c(X^  X)  =  s(X)/2  +  r(X,)/2  if  X  and  X, 
share  an  edge,  and  c(Xj,  X)  -  ( j(X)  +  j(X;))  ( Ji/2)  if  X  and  X,  share  a  comer. 


For  the  simple  path  plaiming  problem,  the  following  assumptions  are  made  about  the  robot  and  its  environment: 

•  Onmidirectioiiaiity:  the  robot  is  oqtable  of  moving  from  state  Y  to  any  state  X  for  which  c(X,  Y)  is  defined. 
For  the  above  environment  model,  the  robot  can  move  in  any  of  the  eight  directions. 

•  Point  Size:  the  robot  has  zero  physical  extent;  thus,  its  workspace  equals  its  configuration  space. 

•  Minimal  Field  View  (FOV):  the  robot  is  equipped  with  a  sensor  capable  of  measuring  the  aC)  value  of  the 
cell  in  which  it  resides  or  that  of  a  neighboring  cell. 

•  Deterministic  Motion:  the  robot  accurately  follows  planned  paths  so  that  “safety  buffers”  around  obstacles  are 
not  needed. 

•  Static  Environment:  the  aC)  values  of  the  cells  are  static  (i.e.,  they  do  not  change  in  time). 

•  Binary  Obstacle  Representation:  the  sC)  and  aC)  values  for  a  given  cell  can  take  on  one  of  two  values: 
EMPTY,  a  small  positive  value  representing  the  cost  of  travosing  a  cell  free  of  obstacles;  and  OBSTA  CLE ,  a  large 
positive  value  infficating  the  cell  contains  an  obstacle  and  is  untraversable.  Note:  these  values  must  be  chosen  so 
that  the  path  cost  for  any  sequence  of  states  through  EMPTY  cells  is  less  than  OBSTACLE. 

•  No  Initial  Map  Information:  nothing  is  known  about  the  environment  initially,  and  it  is  presumed  that 
J(X)  =  EMPTY  for  all  states  X. 

•  Single  Goal  State:  only  one  state  has  an  /tC)  value  of  zero. 

•  Single  Robot:  only  one  robot  moves  through  the  environment. 
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Let  5  be  the  state  in  which  the  robot  begins.  To  use  D*.  the  goal  state  is  placed  on  the  OPEN  list  with 
A(G)  s  IKG)  =  0,  and  PROCESS  -  STATE  is  called  repeatedly  until  h(S)  is  less  than  or  equal  to  .  At  this  point  an 
optimal  path  has  been  oanputed  from  5  to  G.  (Since  all  cells  are  presumed  EMPTY,  this  path  is  direa.)  The  robot 
proceeds  to  step  toward  the  goal,  foUowiug  the  backpointers  in  the  state  sequence,  until  either  it  reaches  the  goal  or  its 
sensor  detects  that  i(X)  *  a(X)  for  a  state  X.  In  the  latter  case,  the  robot  has  detected  an  obstacle,  and  s(X)  is  set  to 
a(X),  c(X, ")  and  cC,  X)  are  updated  for  all  neighboring  states,  and  the  changes  are  entered  onto  the  OPEN  list  via 
function  MODIFY-  COST.  The  routine  PROCESS  -  STATE  is  repeatedly  calted  until  equals  or  exceeds  the  ac) 
value  of  the  state  containing  the  robot.  At  this  point,  a  new  optirnal  path  has  been  cmnputed,  and  the  above  process 
repeats  until  the  goal  is  reached  or  until  k^^  equals  or  exceeds  OBSTACLE.  In  the  latter  case,  the  optimal  path 
contains  an  obstacle;  tberefcxe,  no  obstacle-free  paths  exist  to  the  goal. 

Figure  10  illustrates  simple  motion  planning  with  an  unknown  potential  well.  Unless  otherwise  suted,  all 
environmaits  in  this  section  are  200  x  2(X)  cells.  Unlike  die  example  in  Figure  1  through  Figure  7,  the  robot  assumes 
the  environment  is  devoid  of  obstacles  when  it  begins  its  traverse.  Initially,  the  robot  moves  straight  toward  the  goal. 
When  it  encounters  the  obstacle's  perimeter,  the  robot  moves  down  in  an  attempt  to  find  an  opening  through  the 
barrier,  edges  iqi  slighUy  along  the  lower  wall  as  it  detects  it,  and  then  doubles  back  up  before  finally  moving  along  an 
interior  wall  and  around  the  exteriOT  to  the  goal.  The  OBSTACLE  cells  detected  by  the  robot’s  sensor  are  shown  in 
grey,  and  the  unsensed  cells  are  shown  in  black. 

Figure  10:  Simple  Path  Planning  with  an  Unknown  Potential  Well 


4.2  Field  of  View  Considerations 

Except  for  contact  senscns,  most  robot  sensors  (e.g.,  sonars,  laser  rangefinders,  video  cameras)  have  a  field  of  view 
(POV)  covering  an  area  in  the  vicinity  of  the  robot.  D*  can  easily  accommodate  a  sensor  with  a  FOV  of  any  size. 
When  the  robot  is  moved  from  state  X  to  state  Y  and  new  sensor  data  is  taken,  s{Z)  is  compared  to  a(Z)  for  all  states 
Z  in  the  FOV.  If  *(Z)  *  a(Z)  for  any  state  in  the  FOV,  s(Z)  is  set  to  a(Z) ,  c(Z,  *)  and  c(®,  Z)  are  revised  via 
MODIFY  -  COST,  and  PROCESS  -  STATE  is  repeatedly  called  until  s  h(,Y) .  Thus,  the  only  revision  to  the  simple 
path  planning  algorithm  is  that  potentially  mote  than  one  cell’s  cost  is  trpd&ted  per  sensor  reading. 

Bgure  11  shows  the  same  path  planning  problem  as  Figure  10,  except  that  the  robot  is  equipped  with  a  ciicular-FOV 
sensor  with  a  radius  of  IS  cells.  For  ease  of  implementation,  the  FOV  was  chosen  to  include  all  cells  in  the  circle 
without  occlusicm.  Since  the  robot  can  see  the  “bottom”  of  the  well  before  re^hing  it,  it  changes  course  and  follows 
the  exterior  perimeter.  In  general,  the  larger  the  robot’s  POV,  the  shorter  the  path  it  will  traverse,  since  it  can  see 
obstacles  before  it  “bumps”  than  and  wUl  begin  to  avoid  them  sooner. 
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Figure  11:  Path  Planning  with  a  Circular  Field  of  View 


Real  robots  have  ncm-zefo  size;  thus,  a  path  planning  aIgtMithm  must  ultimately  be  able  to  model  robot  shape.  D*  can 
handle  robot  shape  by  ctmsiructing  the  configuration  space  [11]  as  the  rt^xM’s  sensor  discovers  obstacles  in  the  mvi- 
ronment  Elefine  three  functions:  a^(X  Y),  the  actual  C-space  obstacle  cost  ot  EMPTY  at  OBSTA  CLE  at  robot  config- 
uiatkKi  Y  due  to  an  obstacle  at  location  X;  a^{Y),  the  actual  C-space  total  cost  fa  configuraticHi  Y  equal  to 
OBSTACLE  if  tmy  ajiX,  Y)  =  OBSTACLE  for  applicable  X;  and  sJ^Y),  the  presumed  C-space  total  cost  fw  configura¬ 
tion  Y.  Whenever  the  saisor  discovers  a  discrepancy  between  the  map  and  the  enviitnunent  <i.e.,  s(X)  *  aCO),  s(X)  is 
set  to  <<X),  and  a/,Y)  is  computed  using  ajlX,  F)  for  all  ajpUcable  Y.  For  each  configuration  Y  for  which 
sj(Y)*aj(,Y),  5j(F)  is  set  to  ajlY) ,  MODIFY -COST  is  c^Utid  to  update  cC’)  using  sjC)  rather  than  j(*).  and 
PROCESS  -  STATE  is  called  repeatedly  until  a  new  optimal  path  is  found. 

Hguie  12  illustrates  the  results  fOT  a  disc-sh^ted  robot.  In  this  example,  the  configuration  space  and  the  workspace 
are  both  two-dimensional,  so  the  two  spaces  are  shown  in  the  same  figure.  The  black  area  represents  an  unknown 
obstacle  in  the  woritspace  (i.e.,  oC)  values),  and  the  grey  represents  the  known  C-space  obstacle  (i.e.,  sji’)  values)  for 
cells  exterior  to  the  black  square  and  the  known  workspace  obstacle  (i.e.,  r(*)  values)  for  cells  interiw  to  the  square. 
The  field  of  view  of  the  robm  is  20  cells,  and  the  radius  of  its  disc  stupe  is  10  cells.  Note  that  the  configuration  space 
is  genermed  as  the  robot  discovers  the  unknown  obstacle,  and  it  moves  around  the  obstacle  at  a  stand-off  distance 
equal  to  its  radius.  Of  course,  the  field  of  view  of  the  robot  must  be  at  least  as  great  as  the  robot’s  radius  a  collisions 
cannot  be  avoided.  This  approach  can  be  extended  to  higher-dimensional  configuration  spaces  (e.g.,  three 
dimensional  fa  translation  and  rotation  of  a  polygonal  robot)  by  increasing  the  dimensionality  of  the  planning  space. 
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Figaic  12:  Path  Planning  with  a  Diac-Shapad  Robot 


4.4  Oynamte  EnvIroniMtrts  and  Oaad-Rackoning  Error 

In  many  cases,  it  is  inapprqviale  to  assume  the  robot’s  worid  is  static  [2][3][4][7].  Obstacles  may  move  around 
witbin  Ifae  environment,  new  obstacles  may  enter,  sod  old  cmes  may  leave.  These  changes  may  occur  while  the  robot 
is  eniDute  to  the  goal.  D*  is  o^nble  of  harming  dynamic  environments.  Qianges  in  the  envircoment  are  delected  by 
the  robot’s  sensw.  These  sensor  readings  modify  die  fimctioa  a(*).Wheneva^  a  discrepancy  is  seen  between  the 
actual  world  and  the  presumed  world  (Le.,  a(*)  *  si*)  total  least  (me  state),  the  changes  are  entered  cm  the  OPEN  list 
and  the  robot’s  trqectory  is  modified  if  needed  to  preserve  (^)timality.  These  (Ganges  can  be  of  two  types:  l)an 
EMPTY  ceU  becomes  an  OBSTACLE-,  and  2)  an  OBSTACLE  cell  becomes  EMPTY. 

Figure  13  shows  an  environment  in  whkjh  the  obstacle  has  moved  without  the  robot’s  knowledge.  The  grey  rectangle 
shows  the  original,  presumed  positioa,  and  the  blade  rectangle  shows  the  ciorent,  unknown  position.  Figure  14  shows 
the  trtyecUHy  of  the  robot  through  the  environment.  Believing  the  obstacle  to  be  in  the  grey  position,  the  robot 
initially  deflects  toward  the  bottcan.  When  it  reaches  the  center  of  the  envircmineat,  it  encounters  the  obstacle  in  its 
current  location.  It  moves  along  the  obstacle  toward  the  lower  boundary  of  the  environment,  entering  the  new 
kxration  of  the  obstacle  into  the  mtg)  and  ’’coloring”  it  grey.  After  discovering  the  lower  route  is  obstructed,  it  (kwbles 
bade  to  the  top  whereupon  it  discovers  there  is  no  obstacle  in  the  original  locatkm.  The  obstacle  is  deleted  from  the 
miq;)  as  the  robot  moves  around  the  top  of  the  obstruction  and  to  the  gcal.  Note  that  part  of  the  tniginal  obstacle 
renudns  in  file  map,  since  this  portion  was  unseen  by  the  robot’s  sensor. 

In  the  presoice  of  inaccurate  m^  data,  it  is  possible  for  the  robot  to  mistalsnly  believe  that  no  path  exists  to  the  goal . 
This  condition  is  detected  by  the  function  PROCESS  -  STATE  returning  a  value  equal  to  or  greater  than  OBSTACLE, 
thus  indicating  that  the  sheutest  padi  to  the  goal  passes  through  at  least  one  OBSTACLE  state.  This  cemditioa  should 
not  be  confused  with  a  returned  value  of  ’-1’,  indicating  that  no  sequence  of  arcs  of  even  OBSTACLE  cost  exists  to 
the  goal.  In  the  event  that  a  value  of  OBSTACLE  or  greater  is  returned,  one  strategy  is  to  set  s(*)  to  EMPTY  for  all 
states  in  the  m^,  miter  the  goal  state  on  the  OPEN  list,  invoke  PROCESS -STATE  repeatedly  until  is  greatm 
than  or  equal  to  MX),  where  X  is  the  current  state  of  the  robot,  and  then  move  the  robot.  This  action  has  the  effect  of 
discounting  all  map  information  and  fincing  the  rob(M  to  verify  that  the  obstructions  still  exist  or  discover  that  diey  do 
not 
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F%ure  13:  Before  and  After  Positions  of  a  Dynamic  Obstacle 


Figure  14:  Discovering  that  the  Obstacle  has  Moved 
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D*  can  also  handle  uncertainty  in  the  robot’s  motion  (e.g.,  dead-reckoning  error).  If  the  robot  is  located  at  state  X  but 
its  position  estimation  system  reports  that  it  is  at  ¥,  its  sensor  will  perceive  (incorrectly)  discrepancies  between  the 
map  iud  the  real  wmld  (e.g.,  shift  in  an  obstacle’s  location).  The  discrepancies  will  be  entered  onto  the  OPEN  list  via 
MODIFY-  COST  and  propagated  via  PROCESS  -  STATE  to  compute  a  new  trajectory.  This  new  trajectory  will 
correctly  avoid  the  obstacles  in  the  current  FOV  at  their  "new”  locations.  Provided  the  motion  error  is  small 
compared  to  the  size  of  the  firee-space  corridors  in  the  environment,  the  robot  will  plan  a  correct  local  trajectory  (i.e., 
foi  obstacle  avoidance)  without  adversely  affecting  its  global  trajectory  (i.e.,  route  to  the  goal). 

4.5  Occupancy  Maps  and  Potential  Fields 

In  some  triplications,  a  binary  obstacle  representation  is  inadequate.  Due  to  sensor  uncertainty,  the  robot  cannot 
always  determine  whether  a  cell  is  occupied  or  euqity  but  can  assign  a  probability  of  occupancy[l]  [20].  Otha'  appli¬ 
cations  may  call  for  a  safety  buffer  around  the  obstacles  to  minimize  the  probability  of  collision.  This  technique  can 
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be  used  to  account  for  robot  motkMi  enw.  A  potential  field  [8]  can  be  constructed  by  assigning  high  cost  values  to 
cells  containing  an  obstacle  or  near  an  obstacle  and  Iowa  cost  values  that  decrease  to  zero  to  cells  farther  away. 

D*  is  capable  of  handling  continuous  values  for  a(°),  and  consequently  c(°).  Define  three  functions:  a,()0.  the 
actual  total  potential  at  state  K;  sjiY),  the  presumed  total  potential  at  state  Y;  and  a  (X,  Y),  the  actual  obstacle 
potential  at  stale  Y  due  to  an  obstacte  at  state  X.  In  the  example  below,  for  each  state  X  for  which  s{,X)  *  a(X) ,  s{X)  is 
set  to  a(X),  aJiY)  is  ctanputed  for  each  affected  X  by  summing  a^(X,  Y)  over  all  applicable  X.  For  each  state  Y  for 
which  sjlY)  * ajiY),  j^y)  is  set  to  a,lY),  MODIFY- COST  is  called  to  update  c(®)  using  i,(®)  rather  than  j(°),  and 
PROCESS  -  STATE  is  called  repeatedly  until  a  new  optimal  path  is  fouixl. 

Figure  IS  illustrates  path  planning  with  potential  fields.  The  robot  has  no  knowledge  of  the  obstacles  befiue  it  begins 
its  traverse;  thus,  it  can  construct  the  potential  field  only  when  an  obstacle  appears  in  its  field  of  view.  The  sensor's 
field  of  view  is  10  cells,  and  the  potential  field  decreases  proportionally  to  min(MAXCOST,  l//^),  where  MAXCOST 
is  a  maximum  cost  value  and  r  is  the  distance  from  the  obstacle.  The  two  L*shaped  unknown  obstacles  (black)  are 
changed  to  light  grey  as  the  robot’s  sensor  detects  them.  The  grey  “blur”  along  the  obstacle  edges  is  the  potential  field 
created  from  the  detected  portion  of  the  obstacles.  Initially,  the  robot  presumes  the  environment  is  EMPTY  and  heads 
directly  toward  the  goal.  It  is  repelled  by  the  potential  field  in  the  narrow  channel  and  moves  along  the  boundary  of 
the  uppa  obstacle.  Once  it  has  moved  sufficiently  far  from  the  goal,  it  doubles  back  along  the  boundary  of  the  lower 
obstacle  until  the  estimated  cost  of  the  longa  path  around  ffie  obstacle  exceeds  that  of  the  more  direct  route  through 
the  potential  field.  Thus,  the  plaima  chooses  a  shorta  path  through  a  riskier  area  (i.e.,  close  to  obstacles)  rather  than 
a  l{»ga,  safa  one  and  heads  for  the  goal. 

Figure  15:  Path  Planning  with  Potential  Fields 


4.6  Map  Information  and  Outdoor  Navigation 

So  far  in  this  section,  the  planning  applications  have  assumed  little  or  no  a  priori  map  information.  infcnmation 
is  useful  because  it  can  guide  the  robot  around  obstacles  <x  clear  of  impasses  long  before  they  tqtpear  in  its  sensor’s 
field  of  view.  Even  inconplete  or  ^poximate  information  is  often  more  beneficial  than  no  map  information.  In  gen¬ 
eral,  the  betta  (be  presumed  m^  information  approximates  the  actual  world  (i  e .  4®) «  a(°) ),  the  Iowa  Uk  cost  of  the 
trajectory  driven  by  the  robot  A  pricMri  data,  or  map  information,  can  assume  a  numba  of  forms.  Three  possibilities 
are  listed  below: 

•  Dense  Resolution:  each  cell  is  assigned  an  r(®)  value  corresponding  to  a  separate  measurement  fimn  a  dense 
set  An  example  of  this  type  of  m^  is  a  surveyed  room  or  field.  The  resolution  of  the  map  data  is  commensurate 
with  the  survey  data. 
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•  Coarse  Resolution:  each  cell  is  assigned  the  sC)  value  of  a  sparse  measurement  taken  near  the  cell  or  an  inter¬ 
polated  value  between  measurements.  An  example  of  this  type  of  m^  is  100-meter  elevation  data  recorded  aeri¬ 
ally  that  is  interpolated  to  fill  a  l-meter  resolution  map. 

•  Feature  Data:  cells  corresponding  to  large  n  significant  features  in  the  world  (e.g.,  hills,  lakes,  buildings, 
roads)  labelled  ^>propriately,  and  the  rest  of  the  cells  are  presumed  to  be  EMPTY. 

Miqts  for  outdoor  navigation  typically  record  cost  information  for  difficulty  of  traverse.  For  example,  steep  bills  have 
high  r(°)  values  since  extra  fuel  must  be  expended  to  propel  the  robot  Utewise,  pothole-ridden  terrain  has  high  jC”) 
valiws  since  a  bumpy  ride  is  undesirable.  Extremely  steep  terrain  and  stumps,  bouldm,  and  other  large  objects  have 
inohibitively  high  «(*)  values,  since  these  terrain  features  are  essentially  obstacles  and  carmot  be  traversed  at  any 
cost.  Paved  roads  have  low  rC)  values  and  are  preferred.  D*  is  enable  of  representing  terrain  costs  since  r(°) ,  and 
tberefmre  £(”),  can  rqrresent  a  continuum  of  values. 

Hgure  16  shows  path  planning  across  fractally-generated  nmural  terrain  using  a  complete,  dense  map  of  the  terrain. 
The  environment  is  450  x  450  cells,  and  the  robot’s  field  of  view  is  20  cells.  The  start  state  is  the  lower  left  comer, 
and  the  goal  state  is  the  upper  right  comer.  Black  regions  are  obstacles  and  cannot  be  traversed  at  any  cost  The  grey 
scales  represent  a  continuum  of  cost  values  such  that  dark  grey  regions  are  five  times  more  difficult  to  traverse  than 
white  regions  Since  the  map  is  complete,  aC)  s  and  the  complete  and  final  path  can  be  planned  to  the  goal 
bef(»e  the  robot  begins  its  traverse.  Ute  cost  of  the  path  is  40,426.  This  path  is  referred  to  as  omniscient  optimal, 
since  it  is  the  lowest-cost  path  given  complete  and  accurate  a  priori  map  information. 
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Figure  16:  Path  Planning  across  Natural  Terrain  with  a  Complete  Map 
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Figure  17  P!-iStrates  path  planning  in  tbe  same  terrain  with  no  a  priori  map  information.  In  this  case,  the  optimistic 
assumption  is  made  that  the  environment  consists  only  of  the  lowest-cost  (white)  cells.  Initially,  the  robot  heads 
directly  for  the  goal  and  optimizes  its  path  “locally”  within  its  field  of  view.  Unfortunately,  given  the  lack  of  a  priori 
infcMmation  the  robot  chooses  to  go  to  the  tight  of  the  large  black  obstacle  region  upon  its  first  encounter  and  finds 
itself  moving  around  the  long  side  looking  for  an  opening  in  the  direction  of  the  goal.  After  wandering  into  a  dead 
end,  the  robot  backtracks  around  tbe  last  obstacle  and  finds  tbe  goal.  Tbe  cost  of  tbe  traversed  path  is  107,608;  over 
twice  that  of  the  omniscient  optimal  path.  Even  though  tbe  path  is  of  higher  cost  than  omniscient  optimal,  it  is  still 
q)timal  given  the  information  tbe  robot  had  when  it  acquired  it. 


Figure  17:  Path  Planning  Across  Natural  Terrain  without  a  Map 


Hiese  two  examples  illustrate  opposite  ends  of  a  continuous  spectrum,  and  for  most  applicaticms  they  are  uiuealistic. 
hi  genoul,  some  a  priori  map  information  is  available.  Figure  18  illustrates  planning  over  the  same  terrain  with  coarse 
map  information,  p^haps  measured  from  a  satellite  or  aircraft.  In  this  example,  the  coarse  map  was  created  by 
averaging  the  a(”)  values  in  each  coarse  cell  (i.e.,  square  region)  and  writing  the  average  into  f(°)  for  each  dense  cell 
in  the  region.  Each  coarse  cell  is  56  x  56  dense  ceUs.  Therefore,  r(X)  *  a(X)  for  most  X,  but  for  the  most  part,  is  an 

approximation  to  oC*).  The  map  information  is  accurate  enough  to  properly  guide  the  robot  around  the  large 
obstructions,  and  the  resultant  pt^  is  “globally"  similar  to  that  in  Figure  16  barring  some  “local”  variations.  The  cost 
of  the  path  in  Figure  18  is  42,882.  Thus,  it  overshoots  the  omniscioit-qitimal  path  by  6%  in  cost  Figure  19  is  similar 
to  Hgure  18  exc^  that  a  higher-resolution  nuq)  is  used  (i.e.,  coarse  cells  =  7x7  dense  cells).  The  cost  of  this  path  is 
41,079,  and  it  overshoots  the  omniscient-optimal  path  by  1.6%.  From  this  set  of  examples,  it  can  be  concluded  that 
the  mc»e  accurate  the  jHior  map  data,  the  lower  the  cost  of  the  traverse. 
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Figorc  18:  Path  Plannmg  with  a  Coaree-Resolution  M«|> 


Figwc  19:  Path  Planning  with  a  MadiunvRsaohJtion  Map 
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4.7  Muitipla  Goal  States 

In  the  description  of  D*  in  Section  2.0,  it  is  assumed  that  only  one  state  has  an  AC)  value  of  zero  (i.e.,  there  is  only 
one  goal  state).  D*  pomits  more  dian  one  goal  state.  This  feature  has  several  uses.  For  example,  any  part  of  a  desig¬ 
nated  mea  on  the  floor  may  suffice  as  a  goal;  thus,  all  cells  in  the  area  are  equivalent  goals.  Furthermore,  two  widely- 
separated  doors  leading  out  of  a  room  may  be  considoed  equivalent  goals. 

It  m^  even  become  inqxntant  to  introduce  new  goal  states  whfle  the  robot  is  moving  through  the  environment  For 
exaaiple,  the  robot  may  be  beading  fm  the  one,  known  door  in  a  room  wbra  it  detects  a  second  door  with  its  soisot. 
In  this  case,  the  new  goal  state  X  with  fc(X)  =  0  is  entered  on  the  OPEN  list  and  PROCESS  -  STATE  is  called 
rqteatedly  unti)  equals  or  exceeds  A(l),  where  7  is  the  robot’s  current  state. 
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Figure  20  illustrates  the  use  of  two  goal  states  in  path  planning.  The  a  priori  map  contains  only  EMPTY  cells,  and 
therefore  the  robot  does  not  know  tdwot  the  T-sha^  obstacle.  Initially,  both  goal  states,  C,  and  Cj ,  are  entered  on 
the  OPEN  list  with  k(Gj)  =  AfGj)  =  0.  The  routine  PROCESS -STATE  is  called  repeatedly  until  the  robot’s  start 
state  has  an  optimal  pafo.  Note  that  initially  the  robot  moves  toward  G^  since  G,  is  closer,  and  it  |»esumes  the 
straight-line  is  unotetnicted.  When  the  robot  detects  the  obstacle,  it  attempts  to  move  around  it  to  the  top  and 
then  doubles  back  down  and  to  the  right  Eventually  it  wwks  itself  into  a  position  where  Gj  is  closer  than  Gj  and 
laxKeeds  to  move  to  Gj  instead.  The  robot’s  field  of  view  in  this  example  is  10  cells. 

Figure  20:  Path  Planning  with  Two  Goal  States 


4.8  Muttipie  Robots 

In  some  applications,  two  or  more  robots  operate  in  an  environment  [1S][21].  For  example,  consider  two  robot  scouts 
returning  to  a  home  base  across  largely  unknown  terrain  afta  performing  a  recotmaissaiKe  missioiL  Both  robots  are 
equii^ted  with  sensors  to  measure  terrain  properties.  Assuming  the  robots  caimot  interfere  with  each  other,  a  simple 
way  of  inqrlementing  this  mission  is  to  equip  both  robots  with  a  priori  maps  and  instruct  them  to  move  independently 
toward  the  goal.  It  is  clear  firom  previous  sections  how  to  inqtlonent  this  mission  with  D*.  With  this  arrangement, 
however,  neither  robot  benefits  ^m  the  sensor  readings  of  the  otho*  robot.  If  the  two  robots  share  a  map,  then  obsta¬ 
cles  detected  by  one  robot  ate  available  to  the  other. 

Conskter  the  example  in  Figure  21.  Robots  Rj  and  Rj  ^  equipped  with  a  one-cell  FOV.  They  move  toward  the  goal 
state  G  using  a  m^  of  the  envirotunoit  containing  the  grey  obstacle.  Because  they  are  unaware  of  the  black  obstacle, 
both  robots  plan  to  move  over  the  top  of  the  grey  obstacle  and  down  to  the  goal.  Rj  is  ahead  of  Rj  •  ^  robots 
move  forward,  R^  discovers  that  the  black  obstacle  obstructs  its  path.  This  information  is  effectively  communicated 
to  /t2  via  the  shar^  map,  and  Rj  chooses  an  alternate  route  and  changes  course  long  before  it  reaches  the  impasse.  In 
(»der  to  use  D*  in  a  shared  arrangement,  whenever  a  discrepancy  is  discovered  between  the  presumed  world  and  the 
actual  world  (i.e.,^X)  *  a(X)  for  some  state  X)  by  eitho-  robot’s  sensor,  the  changes  are  entered  onto  the  OPEN  list 
via  MODIFY -COST,  and  process-state  is  called  repeatedly  until  exceeds  the  hO  values  of  both  robots. 

Each  robot  is  free  to  move  (optiinaliy)  when  its  own  hC)  value  equals  or  is  exceeded  by  .  O'"  is  most  efficient 
when  the  two  robots  are  located  (Hi  cells  with  approximately  the  same  hO  value. 


5.0  Experimental  ftesults 

D*  was  compaied  to  tbe  optimal  refdmuier  to  verify  its  (^)dmality  and  to  determine  its  performance  improvement. 
The  optimal  r^lanner  initially  plans  a  single  path  from  the  goal  to  tbe  start  state.  Tbe  {axtceeds  to  follow  tbe 
path  until  its  sensor  detects  an  anx  in  tbe  m^  (i.e..  i(X)  *  a(X)  for  some  X).  The  rc^t  updates  tbe  map,  plans  a  new 
path  firrantibe  goal  to  its  curtmtiocaticm,  and  rqjeats  until  the  goal  is  reached.  An  optiinisticbeuristic  function  |(X)  is 
used  to  focus  tbe  search,  such  that  KX)  equals  the  “straight-line”  cost  of  the  path  from  x  to  tbe  robot's  location 
assuming  all  cells  in  between  are  EMPTY.  Tbe  teplanner  repeatedly  expands  states  on  the  OPEN  list  with  tbe  mini- 
mion  |(X)  +  h(X)  value.  Since  |(X)  isalowerboundon  the  actual  cost  from  X  to  the  robot  fw  all  X,  the  teplanner  is 
optimal  [14]. 

The  two  algorithms  were  compared  on  plaiming  problems  of  varying  size.  Eadi  environment  was  square,  consisting 
of  a  start  state  in  the  center  of  the  left  and  a  goal  state  in  center  of  the  right  wall.  Each  environment  consisted  of 

a  mix  of  map  obstacles  (i.e.,  available  to  robot  before  traverse)  and  unknown  obstacles  measurable  by  the  robot’s 
sens(»:  The  soisor  used  was  omnidirectional  widi  a  10<ell  field  of  view.  Figure  22  shows  an  environment  model  with 
100,000  states.  Tbe  map  obstacles  are  shown  in  grey  and  the  unknown  (^Ktades  in  black. 


Figore  22:  Typical  Environment  for  Path  Planning  Comparison 


Table  1  shows  the  results  of  the  comparison  for  environments  of  size  10(X)  through  1,000,000  cells.  Tbe  runtimes  in 
CPU  time  for  a  Sun  Microsystems  SPARC-10  processm*  are  listed  along  with  the  speed-up  factor  of  D*  over  tbe 
optimal  replanner.  For  each  environment  size,  the  two  algorithms  were  compared  on  five  randomly-generated 
environments,  and  the  runtimes  were  averaged.  The  speed-up  factors  for  each  environment  size  were  computed  by 
avera^g  the  speed-up  factors  for  the  five  trials. 
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The  nmtiine  to  each  algorithm  is  highly  dependent  on  the  cmnplexity  of  the  environment,  including  the  number, 
size,  and  placement  of  the  (^stacles,  and  the  ratio  of  map  to  unknown  obstacles.  The  results  indicate  that  as  the 
envhroDmeat  hicreases  in  size,  the  pertomance  of  D*  over  the  optimal  replanno^  increases  rajadly.  The  intuition  for 
this  result  is  that  D*  rqdans  locally  when  it  detects  an  unknown  obstacle,  but  the  optimal  leplanner  generates  a  new 
global  tn^tory.  As  llm  envircmment  increases  in  size,  the  local  trajectories  remain  constant  in  oanplexity,  but  the 
global  trajectories  iiKiease  in  cmnplexity. 

Note  that  evoi  to  large  environments  (e.g.,  1,000,000  cells),  D*  is  a  real-time  algorithm.  If  the  environment  consists 
of  square-meter  resolution  cells,  then  a  1,000,000-cell  environment  is  a  square  kilometer.  If  a  robot  drives  the  width 
of  tie  stpiare-sluqted  terrain  using  the  optimal  replanner,  its  average  speed  will  be  limited  to  1.2  km/hr  at  best.  If  D* 
is  used,  the  qteed  will  be  limited  by  the  robot  itself.  This  is  inqmrtant  since  any  plantter  for  unknown  and  dynamic 
enviromnents  must  necessarily  operate  in  lock-step  with  a  moving  and  sensing  robot 


Table  1:  Comparison  of  D*  to  Optimal  Replanner 


Algorithm 

1,000 

10,000 

100.000 

1,000,000 

Replanner 

427  msec 

14.45  sec 

10.86  min 

50.82  min 

D* 

261  msec 

1.69  sec 

10.93  sec 

16.83  sec 

Speed-Up 

1.67 

10.14 

56.30 

229.30 
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6.0  Conclusions 

6.1  Summary 

Hds  papa  presents  D*.  a  provably  optimal  and  efficient  path  planning  algcffithm  tor  sensor-equin>ed  robots.  The 
algorithm  can  handle  the  full  specinun  of  a  i»iori  map  information,  ranging  from  complete  and  accurate  infor- 
matkm  to  the  absence  of  map  Monnation.  A  number  of  applicaticms  are  illustrated,  including  planning  with  robot 
shiqte,  field  of  view  considerations,  dead-reckoning  error,  changing  environments,  occupancy  maps,  potential  fields, 
nanwal  terrain,  multiple  goals,  md  mult^le  robots. 

D*  is  a  very  general  algorithm  and  can  be  tqiplied  to  problems  in  artificial  intelligence  other  than  robot  motion 
planning.  In  its  most  general  fcmn,  D*  can  handle  any  path  cost  optimization  luoblem  where  the  cost  parameters 
change  during  the  search  for  the  solution.  D’*'  is  most  efficient  when  these  changes  are  detected  near  the  current 
starting  point  in  the  search  space,  which  is  the  case  with  a  robot  equipped  with  an  on-board  sensor. 


6.2  Future  Work 

For  unknown  or  partially  known  terrains,  recent  research  Utorahue  has  addressed  the  exploration  and  map  building 
{MObiems  [12][16][17I[18][22]  in  addition  to  the  path  finding  problem.  Using  a  strategy  of  raising  costs  for  {ueviously 
visited  states,  D*  can  be  extended  to  support  explraation  or  acquisition  tasks. 

Quad  trees  have  limited  use  in  environments  with  cost  values  ranging  over  a  continuum,  unless  the  environment 
inrliide.s  latge  regkms  with  constant  traversaUlity  costs.  Future  woik  will  incorporate  the  quad  tree  representation  for 
these  environments  as  well  as  those  with  binary  cost  values  (e.g.,  OBSTACLE  and  EMPTY)  in  order  to  reduce 
memenry  requirements  [22]. 

Alffiough  D*  has  been  shovm  to  be  efficient,  there  is  room  f(»  improvement.  Presently,  the  effects  of  a  cost  change  are 
propagated  out  from  the  modified  arc  in  all  directions.  It  may  be  possible  to  bias  this  propagation  in  the  direction  of 
the  robot  by  using  a  heuristic  fimcticHi  similar  to  that  employed  in  A*  [14],  thus  resulting  in  a  new  optimal  path  to  the 
robot’s  state  with  fewer  state  expansions.  A  function  must  be  selected  that  provides  a  lower  bound  on  the  true 
cost  from  the  modified  arc  to  the  robot’s  state  to  preserve  optimality.  There  are  two  complications.  First,  the 
robot  is  in  motion,  so  K”)  must  be  recomputed  for  each  slate  on  the  OPEN  list.  Second,  using  tK”)  +  H")  instead  of 
h(’)  will  require  a  new  definition  for  kC)  that  preserves  completeness  and  optimality. 
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